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Abstract 

We investigate the space X of unitary hermitian matrices over p-adic fields through 
spherical functions on X. First we consider Cartan decomposition of X, and give precise 
representatives for fields with odd residual characteristic, i.e., 2 ^ p. In the latter half 
we assume odd residual characteristic, and give explicit formulas of typical spherical 
functions on X, where Hall-Littlewood symmetric polynomials of type C n appear as a 
main term, parametrization of all the spherical functions. By spherical Fourier trans- 
form, we show the Schwartz space S(K\X) is a free Hecke algebra %{G, ET)-module of 
rank 2 n , where n is the size of matrices in X, and give the explicit Plancherel formula 
on S(K\X). 



0. Introduction 

Let k! be an unramified quadratic extension of a p-adic field k, and we consider hermitian 
and unitary matrices with respect to k'/k. For a matrix A = (aij) G M mn (k'), we denote by 
A* G M nm (k') the conjugate transpose with respect to k'/k, and say A is hermitian if A* = A. 
We introduce the unitary group and the space of unitary hermitian matrices: 



G = U (j 2n ) = { g e GL 2n (k') | g*hng = hn} , hn 



/0 1 N 
\l 0, 



G GL 2n (k'), 



X = {x G G | x* = x, * xhn (t) = (i 2 - l) n } , 

where & y (t) is the characteristic function of the matrix y. The group G acts on X by 

g- x = gxg*, (g G G, x G X). 

We investigate spherical functions on X, i.e., common eigenfunctions on X with respect to the 
action of the Hecke algebra 1-L(G,K), where K = G fl GL 2n {Oy). The Borel group B of G 
consisting of all the upper triangular matrices in G satisfies the Iwasawa decomposition G = 
KB = BK. The space X can be considered as the set of fc-rational points of a G-homogeneous 
X, where G is a reductive group defined over k such that G(k) = G (cf. Appendix |Aj). In 
the following, we fix a prime element ir in k and the absolute value | | on k normalized by 
jvrp 1 = q = / (vr)) . By a general theory, typical spherical function on X can be constructed 
by Poisson transform from certain relative £?-invariants on X, and we introduce a spherical 
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function uj{x; s) for x G X and s G C n as follows (for details, see (|2.3|1 ): 

u(x;s)= T\\di(k-x)\ Si+Bi dk, (0.1) 
f=i 

where di(y) is the determinant of the lower right i by i block of y, e G C ra is a certain fixed 
number, d/c is the Haar measure on if. The above integral is absolutely convergent if Re(sj) 
Re(ej), 1 ^ i ^ n, continued to a rational function of q Sl , . . . ,q Sn , and becomes a if -invariant 
function on X, hence u(x; s) G C°°(K\X) for each s G C n . 

In 52 we consider the Cartan decomposition, the if -orbit decomposition, of X. Set 

x x = Diag(ir Xl , . . . , vr A ' 1 , n~ Xn tt~ Ai ) G X, (0.2) 
A+ = { A G Z n | Ai > A 2 > • • • > A n > 0} , (0.3) 

For A, /i G A+, we see 

if ■ x x n if ■ Xf, = 0, if A ^ /I, 

since each belongs to a different GL2 n (0fc')~double coset in GL2 n {k r ). We will show the 
following (cf. Theorem II .1| Proposition 11.21 Theorem 11.81 Theorem II .9p . 

Theorem 1 (1) If k has odd residual characteristic, the if -orbit decomposition of X is given by 

X= [J K-x x . (0.4) 

AeA+ 

(2) If k has even residual characteristic, there exists a if -orbit which does not contain any 
diagonal matrix, for each n ^ 1. 

(3) There are precisely two G-orbits in X, independent of the residual characteristic of k. 

In and after Sj2j we assume that k has odd residual characteristic, i.e. q is odd. The Weyl 
group W of G with respect to the maximal /c-split torus in B acts on rational characters on B so 
does on s, and we consider the functional equations of ui(x; s) with respect to W. It is convenient 
to introduce a new variable z G C n which is related to s by 

Si = -Zi + z i+1 , (1 < i < n), s n = -z n , (0.5) 

and we write uj(x; z) = uj(x; s). The Weyl group W is generated by S n which acts on { zi | 1 ^ i ^ n} 
by permutation of indices and r which acts as r(z n ) = — z n and r(zj) = Z{ for i < n. As for 
z-variable, the H(G, if )-action on w(x;z) can be written as (cf. (|2.9|) ) 

(/*a;(;z))(z) = A,(./>(x;z), f eH(G,K), (0.6) 

where * is the convolution action of %{G,K) on C°°(if\X), and A^ is the Satake transform 
H(G,K) ^C[q ±2z \...,q ±2z "] W . 

Denote by (resp. ST) the set of all positive short (resp. long) roots of G (cf. (|2.19p ). As 
for functional equations and the location of zeros and possible poles of uj(x; z), we will show the 
following (Theorem 12.61 Theorem 12. 7ft : 

Theorem 2 (1) For every a G W, one has 

lv(x; z) = T a (z) ■ u;(x; a(z)), 



2 



Spherical functions on the space of p-adic unitary hermitian matrices 



where 

and £+(ct) = S+na(-S+). 
(2) The function 



T °( z )= 11 



q (a,z) _ q -V 
oeS+(cr) 



1 + 



contained in C[g ±21 , . . . , g ,±2n ] M/ (= 7?., 



In 331 we will give the explicit formula for uj{x\;z) for each A G A+ (Theorem 13. 1|) by a 
method introduced in [HirlOj, which is based on functional equations of oj(x;z) and some data 
depending only on the group G. Since uj{x\z) is AT-invariant for x, it is enough to consider the 
explicit formula for x\, X £ A+ by Theorem 1. 

Theorem 3 For each X G one has 

W2n{-q ) X \ l + q\ a > z ) 
aeSJ 



where 



Wm (t) = f[(l - f ), C A = Mn~<+l)g-^ A t (»-*+^) j 

i=l 

o*w- E *>- n tV n 1 rW 



By Theorem 2, we see Q\(z) is a polynomial in 7Z. On the other hand, this is a specialization 
of Macdonald polynomials, and it is known that the set {Q\{z) \ X G A„} forms a C-basis for 1Z 
and Qo(z) is a constant (for details, see Appendix [B]). Hence, for xq = l^n, we have 

- — — x ii ■ (0 - 8) 

QGS+ 



In 21 we consider the spherical Fourier transform on the Schwartz space S(K\X): 
F : S(K\X) — > ft 

v 1 — ► %) = /x?'W $ ( :c ;# 1 

where ^>(x;z) = co(x; z)/uj(l2 n ', z) and dx is a G-invariant measure on X. We will show the 
following (cf. Theorem 14.11 Corollary 14.21 Theorem I4.5[) : 

Theorem 4 (1) The spherical Fourier transform F is an T~L(G, AT)-module isomorphism, in 
particular, S(K\X) is a free H(G, AT)-module of rank 2 n . 
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(2) For each z G C n , the set 



^(x; z + u) u G {0, } n J- forms a basis for the spherical 



functions on X corresponding to X z . 

(3) (Plancherel formula) We give explicitly the normalization of dx on X and a measure dfj,(z) 
on 



In [Hirllj , we have investigated spherical functions on a similar space Xt associated with each 
nondegenerate hermitian matrix T, and obtained functional equations of hermitian Siegel series as 
an application. Both spaces, Xt and the present X, are isomorphic to U(2n)/U (n) x U (n) over the 
algebraic closure of k, and the former realization was useful for the application to hermitian Siegel 
series. But it was not easily understandable, and we could not obtain its Cartan decomposition, 
nor complete parametrization of spherical functions. We discuss the correspondence between 
both spaces in Appendix [Cl and see many results on the present space X are inherited to the 
former spaces Xt ■ 

Throughout of this article except Appendix \E\ where we explain about unitary hermitian 
matrices in a general setting, we denote by A: a non-archimedian local field of characteristic 0, fix 
an unramified quadratic extension k' and consider unitary and hermitian matrices with respect 
to k'/k. We fix a prime element ir of k, denote by v 7T ( ) the additive value on k, and normalize 
the absolute value | | on k x by |vr| _1 = q = fj( 0^/(71-)). We also fix a unit e G (D£ for which 
k' = k(^). We may take e such as e — 1 G 40^, so that {1, 1+ 2 V ^ } forms an O^-basis for 
(cf. |Ome73l 64.3 and 64.4]). From $2]to §H we assume that q is odd. 



1. The space X and its K-orbit decomposition and G-orbit decomposition 

Let k' be an unramified quadratic extension of a p-adic field k and consider hermitian matrices 
and unitary matrices with respect to k'/k. For a matrix A G M mn (k'), we denote by A* G M nm (k') 
its conjugate transpose with respect to k'/k, and say A is hermitian if A* = A. 

We consider the unitary group 




for which 




1 



) 



G = G n = { g G GL 2n (k') \ g* 'j 2n g = hn) 



J2n = 



G M 2n 



(1.1) 



V 



o 



the space X of unitary hermitian matrices in G 



X = X n = {x G G | x* = x, ® xhn {t) = (t 2 - l) n } , 



(1.2) 
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and a supplementary space X containing X 

X = X n = {xeG\ x = x*}, (1.3) 

where $ y (t) is the characteristic polynomial of the matrix y. The group G acts on X and X by 

g-x = gxg* = x[g*] = gxj 2n g~ 1 j2n, 9 G G, x G X. 

As is explained in Appendix [Aj we may understand X as the set of ^-rational points of a G(k)- 
homogeneous algebraic set X(k) defined over k, where k is the algebraic closure of k. 
We fix the maximal compact subgroup K of G by 

K = K n = GnM 2n (O k ,). (1.4) 

The main purpose of this section is to give the Cartan decomposition of X, i.e., the i^-orbit 
decomposition of X for odd q (Theorem II .ip . and G-orbit decomposition of X (Theorem II .9p . 

To start with, we recall the case of unramified hermitian matrices. The group Go = GL n (k') 
acts on the space H n (k') = {y G Go \ y* = y} by g • y = gyg* , and there are two Go-orbits in 
T-L n (k') determined by the parity of v n (det(y)). Setting Kq = GL n {Oy\ the Cartan decomposi- 
tion is known (cf. [Jac62]) as follows: 

U n (k')= \_\ K -tt x , (1.5) 

AeAn 

where 

tt x = Diag(ir x \...,Tr x "), A n = { A G 7L n \ \ x > A 2 ^ • • • > A n } . 

Theorem 1.1. Assume that k has odd residual characteristic. Then, the K -orbit decomposition 
of X n is given as follows: 

X n = [J K-xx, (1.6) 

AeA+ 



where 

A+ = {AsZ"| Ai^---^A n ^0} 

7T A C 
7T~ 

For a = (ciij) G M2 n (Ofe'), we set 

- £(a) = min{u 7r (ay) | 1 < i, j < rt} , (1.7) 

and say an entry of a to be minimal if its u^-value is — 1(a). For g G G, we see £(g) ^ 0, since 
v,r(det(p)) = 0. For regularization of x G X, we often use elements in K of the following type: 

jh llj), for^G^o, 
'in aj N 



for o € M„(Ofc/), a + a* = 0. (U 



Proposition 1.2. Let n = 1. Then 



^0 v 7 l<r<«„-(2) 
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Proof. For x 



where the latter union is empty if q is odd. 
a p 

f a{p + p>) ac + f3 2 
ac + (3* 2 c(/3 + /3*) / 

If a = or c = 0, we have f3 = ±1, hence a = c = and x = ±j2 ^ X\. Hence ac ^ for a; G Xi, 
and we may assume 

a, b, c G A;, ac + 6 2 e = 1, 
^(a) ^ «7r(c), c is a power of 7r. 



G Xi, we have 



J2 = J2[X\ 



a by/e 
-b^fl c 

^ 0, then v n (b) ^ —£, and 
A • X 3 1 



If %(c) 



.° 1 

where each £ gives different K\ -orbit. 



a b^\ 



vr* 
7T- 



el, 



Next assume ^(c) = r > 0, then 6 G 6 2 e = 1 (mod (7r 2 )) and x £ K. Thus g is even, 



6 = 1 (mod (7r)) and a; = j'2 (mod (vr)), since e G 1 + 40^ . We may rewrite 

a' £ O k , < m < r, 



r / 
7T a 



l + 7T m 7 

1 + vr m 7* vr r 



Thus, we obtain 

K ■ x 3 



1 b Q ^l 
1 



7 G O v , 7 G 0* if m < r. 

7T m ( 7 + 7*) + 2 = 0, 7r 2m X( 7 ) = vr 2 V. 

ng 7 = 6 + b 
1 + vr r 7 = -(l + 7T r & )\/e. 



Since $w 2 (i) = i 2 — 1, we have 



By the latter equation we have m = r, and setting 7 = 6q + 61 1+ 2 , we have 



TT- r 1 



7T 



(= x r ,say), 1 < r ^ v n (2). 



I£ K ■ x r contained a diagonal matrix it must be I2, and kx r = jikji f° r some k € K. By the 
latter equation we get det(fc) = (mod (n)), which is impossible for k G K. Similarly we may 
prove x r £ K ■ x s if r 7^ s, which completes the proof. □ 

Lemma 1.3. Let n ^ 2 and assume that x G X n has a minimal entry in the diagonal. Then K ■ x 
contains a hermitian matrix of type 



7T £ 











y 














y G X n _inM 2n _ 2 (7r-Y?* 



where £ = £{x). If x G X n , then the above y G X n _i. 

Proof. By the action of W, we may assume the (2n, 2n)-entry is minimal. Then, by (|1.5p and 
(|1.8p , we see there is some x' G K ■ x whose lower right n by n block has the form 



\ 



\ o---o 
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Then, by taking a suitable matrix of type 

/ 

'In A 
In 



h 



G K, A 



-a n ■ ■ ■ -a 2 


a 




0,2 












eM n (k'), a + a* = 0, 



h ■ x' becomes the following form 



V 



c 


C2 


• • • C2n-1 


b 


* 

C2 









C2ra-1* 




y 





b* 








7T- 1 



b = 7r - i {b + b l ^), with 
eX n , b ,h£O k , 6i = or 6i ^ 20 fe , 
c G ir- e O k , a G vr- £ C> fc '. 



(1.9) 



□ 



Since j2 n [^ ■ x'] = j2 n , we have 

6 = 0, c = 7r e , a = (2 ^ i ^ 2n - 1), 

and then y G and it is clear that y G X n _i if x G X n , which completes the proof. 

Lemma 1.4. Let n ^ 2 and assume that x G X n has a minimal entry outside of the diagonal and 
the anti-diagonal. Then K ■ x contains a hermitian matrix of type 

\ 



\ 



TT 1 























y 














7|-< 



y G X n _ 2 n M 2 „_ 4 (vr € O fc /), 



where i = ^(x). If x £ X n , the the above y G X n _2- 

Proof. By the assumption, the minimal entries appear in pair not in the anti-diagonal. Then, by 
the action of W, we may assume the (2n, 2n — l)-entry and the (2n — 1, 2n)-entry are minimal. 
Then, by fjl .5j) and (jl.8p . we see there is some x' G K ■ x whose lower right n by n block has the 
form 



0' 

Vo 















TT~ l 

.-I 



7T 

Taking the similar procedure (twice) to the proof of Lemma 11.31 we obtain a matrix of the 
required form. □ 

Lemma 1.5. Let x G X n with n ^ 2. Assume that any minimal entry of x G X n stands in the 
anti-diagonal but not all the entries of the anti-diagonal are minimal. Then K ■ x contains a 
hermitian matrix of the same type as in Lemma \1.4\ 

Proof. Set t = £(x). By the action of W, we may assume 



x 



a e 

c b 



a,b,c£ it t+1 O k >. 
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Then, for the matrix 



V 



1 1 
















1 







l-2n-4 











1 


-1 





1 



J 



l{h ■ x) = £(x) and the (1, 2n — l)-entry of h ■ x is equal to — £ + a — b + c and minimal. Then, 
h ■ x satisfies the assumption of Lemma 11.41 an d the result follows from this. □ 

Lemma 1.6. Let x E X n with n ^ 2. Assume that any minimal entry of x stands in the anti- 
diagonal and that all the entries in the anti-diagonal are minimal. Denote by the (i, 2n—i)-entry 
of x, (1 ^ i ^ n). Then 

(i) On has £(x) = 0, x G K, and £j = ±1 (mod (vr)), 1 ^ i ^ n. 

(ii) If £i ^ £j (mod (tt)) for some i and j, which occurs only when 2 ^ (it), then K ■ x contains 
a hermitian matrix of type 

2 \ 

€K, y e X n - 2 r\M 2n -i{O kl ), 



( 12 





o \ 





y 





u 





la ) 



where we understand the above matrix is I4 when n = 2. If X € X n , then the above y G Y n _2- 
(iii) If k has odd residual characteristic and x = ±j2n (mod (vr)), then x ^ X n . 

Proof, (i) By the assumption, we see ^(det x) = 2t! 7r (£i • • • £ n ) = —2£n, which must be 0, hence 
I = and 







(mod (7r)). 



/ 



Since j2nH = J2n 5 we have = £j* 2 = 1 (mod (71")), hence & = ±1 mod (7r) for every i. 

(ii) Now we assume 2 ^ (7r) and & ^ £j (mod (ir)) for some i and j. We may assume £1 ^ £2 
(mod (7r)) by the action of W, and write 

/ 



a b 




c 


6 


b* d 


* 




/ 


* 


* 


* 


c* 6* 






h 


6* /* 


* 


ft* 


r 



For h € K with 



1 






1 











l2n-4 





1 








1 





-1 


1 
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the lower right 2 by 2 block of h ■ x becomes 



a + c + c*+g + + = ( 2£i 

-b* + h* + - £ 2 d-f-f*+r J- I 26 



(mod (vr)), 



which is unimodular hermitian of size 2, since 2 ^ (ir), and we may change it into I2. Then, the 
similar procedure (twice) to the proof of Lemma 11.31 we see K ■ x contains an element of the 
required form. 

(hi) If q is odd and x = cj n (mod (ir)) with c = ±1, then <&xj 2n (t) = (* _ c) 2n ^(t 2 - l) n 
(mod (7r)), hence x ^ X n . □ 



Now Theorem 11.11 follows from Lemmas 11.31 to 11.61 

We consider even residual case. 



Lemma 1.7. Assume that q is even and x G X n n K satisfies x = j 2n (mod (tt)). Then, K ■ x 
does not contain any diagonal matrix, and represented hy a matrix of the following type: 

/vr-^(l-e) -y/e\ 



7T 



'1(1-6) -Vi 



7T' 



7T^ / 



where each empty place means zero-entry, and 

li G A^ 2) = { /x G A+ I u jr (2) ^ Ml > • ■ ■ > ^ 1} • 

Proof. Ii K ■ x contains a diagonal matrix, it must contain l2 n , since x £ K. Assume k ■ x = l 2n 
for some k £ K, and write 



a 6 



, a,b,c,d£ M n (O k ,). 



k c d 

Then, since k satisfies kx = j 2n kj 2n , we have 

k " Cna ^) (m ° d (7F)) ' 

which contradicts to the fact det(/c) G 0^,, hence -fT • x does not contain any diagonal matrix. 

Next we will show that K ■ x contains an E n (fj) of the above type. Since j 2n £ X n , we may 
write 



x = hn + vr m y, m > 0, ^ y = y* £ M 2n (O k >), t{y) = 0, 



(1.10) 



where £(y) = means that minimal entry of y is a unit. If any entry in the anti-diagonal of y is 
a unit and all the other entries contained in (n), then det(y) G . On the other hand 

(t 2 - l) n = $ xj2n (t) = det(il 2n - (j 2n + n m y)j 2n ) = det((t - l)l 2m - vr m yj 2n ), 

and 

= $ xi2 „(l) = det(-7r m yj 2n ) = (-l)™^ 2 "™ det(y), 
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which is a contradiction. Hence there is a minimal entry of y not in the anti-diagonal. Then 
following the proof of Lemmas 1 1 . 31 to [T31 there exists some k G K, for which k ■ y becomes (|1.9p 
with I = 0. Since k ■ x = jm + ^ m (k ■ y) satisfies {k ■ x) ■ j = j, looking at the 2ra-th row, we have 



d = 0,i^2, 2 + 2vr m 5 + 7r m 6i = 0, 



and 



Then, by acting 



k • x becomes 



/ 7T m C 





-(l + 7T m 6 )v^ 


k-x= 







V (1 + vr m 6 ) 





7T m 



1 









l2(rt-l) 













, t = h(n-i) (mod (7T m )), 



G K, 



vr m (l-e) 




















7T m 



£ = i2(n-l) (mod(vr m )). 



Repeating the same procedure, we conclude the proof. 



□ 



Now, by Lemmas 11.31 to [T31 Lemma ll.6l -(i). and Lemma [L71 we see the following. 
Theorem 1.8. Assume that q is even. Then 

'D r (X) 



X n = U U K ■ X X , U , X X ,u = 

r=0 A6A+ 

where D r (\) and D r (—X) are related to x\ by 

/ D r (X) 



E n _ r (n) 
D r (-X). 



D r (-X) 



G X r , 



and xa iA j is understood as x\ (resp. E n (/i) ) if r = n (resp. r = 0). Further one has 

U K-x x = U K- x x JEM (/uGA^). 

AeA+ AeA+ 



As a corollary of Theorem 11.11 and Theorem 11.81 we have the following. For A G A+ , we set 
|A| = Xa=i an d call A to be even or odd according to the parity of |A|. 



Theorem 1.9. There are precisely two G-orbits in X n : 

X n = G ■ x U G ■ xi, x = l 2n , xi = Diag(ir, 1, . . . , l,7r _1 ). 

If q is odd, then 

G-x = [J K-xx, G-xi= [J K-xx- 



(1.11) 



AeA+ 

even 



AeA+ 

odd 



If q is even, xx,a is G-equivalent to xq if and only if \X\ + \fi\ is even. 
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Proof. For unramified hermitian matrices, it is known that T-L m (k') has two GL m (/c')-orbits de- 
termined by the parity of v 7T (det(y)) and H 1 ^, U{y){k)) = C 2 , where T = Gal(k/k), y G H m (k') 
and m #s 1. If q is odd, each representative x\ of iC-orbit in Theorem 1 1.1 1 is diagonal; if q is even, 
by the action of B, x\n in Theorem 1 1 . 8 1 b ecomes diagonal, hence there are at most two G-orbits 
in X n , independent of the parity of q. We recall G(k), X n (k) and ^-action in ()A.3p in Appendix 
[A] for m = 2n, and set 

H(k) = {he G(k) I h*l 2n = l 2n }, 

then it is easy to see 

1 ' " a + bj, a-bj G U(l n )(k) 



H(k) 



G GL 2n (k) 



a 

Jbj jaj / 
U(l n )(k) x U(l n )(k). 
By the exact sequence of T-sets 

1 — ► H(k) — ► 



G(k) 
9 



X n {k) 



we have an exact sequence of pointed sets (cf. |Ser641 I-§5.4]) 

1 — > G ■ l 2n — > X n — > H^T^ik)) -U H\T,G(k)). 



(1.12) 



Since 77 is a map from C 2 x G2 to C2, Ker(ry) cannot be trivial and G • l2n 7^ X n . Hence there 
are at least two G-orbits in X n , thus exactly two G-orbits and they are given as above. □ 



2. Spherical function uj{x\ s) on X 

2.1. For simplicity, we write j = j n , and take a Borel subgroup B of G by 



c - < 1 A) Co f 1 * « 



b is upper triangular of size n 
a + a* = 



where 1? consists of all the upper triangular matrices in G. 

We introduce a spherical function s) on X by Poisson transform from relative B- 
invariants. For a matrix g G G, denote by the determinant of lower right i by i block 

of 5. Then d((x), 1 ^ i ^ n are relative B-invariants on X associated with rational characters 

of B, where 

di(p • x) = ipi(p)di(x), %bi(p) = N k , /k (di(p)), (x G X, p G B). (2.1) 

We set 

X op = {x G X| / 0, 1 s: i < n}. (2.2) 

For x G AT and s G C™, we consider the integral 

„ n 

co(x;s) = / \d(k-x)\ s+e dk, \d(y)\ s = H\d t (y)\ s \ (2.3) 
^ f=i 
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where dk is the normalized Haar measure on K, k runs over the set {k G K \ k ■ x £ X op }, and 

e = e + (^El,...,^El), eo = (_!,... ,-!,-!) eC ". (2.4) 
log q log q 2 

The right hand side of (|2.3p is absolutely convergent if Re(sj) ^ — Re(ej) = — £o,«, 1 ^ « ^ n, and 
continued to a rational function of q si , . . . , g Sn , and we use the notation co(x; s) in such sense. 
We note here that 

IV>(p)I £ (= n \Mp)\ £ ^J = Mp)\ eo = sHp), (2.5) 

where 5 is the modulus character on B (i.e., d(pp') = 5(p')~ 1 dp for the left invariant measure dp 
on B). 

By a general theory, the function u(x; s) becomes an T~L(G, i^)-common eigenfunction on X 
(cf. [Hir99l §1], or [HirlO, §1]), and we call it a spherical function on X. More precisely, the Hecke 
algebra *H(G, K) of G with respect to K is the commutative C-algebra consisting of compactly 
supported two-sided if-invariant functions on G, which acts on the space C co (K\X) of left K- 
invariant functions on X by 

(/**)(?/)=/ f(g)^(g- 1 -y)dg, (/ e H{G,K), * G C°°(K\X)), (2.6) 

where dg is the Haar measure on G normalized by J K dk = 1, and we see 

(/*w(; S ))(x) = A a (/Mx;a), (/ G H(G,K)), (2.7) 
where A s is the C-algebra homomorphism defined by 

As : ft(G,tf) — ►C( g s V..,g a "), 

/— ► / /(p)i^(p)r s+£ *. 



We introduce a new variable z which is related to s by 

Si = -Zi + z i+ i (l^i^n-1), s n = -z n (2.8) 

and write u{x\ z) = u(x; s). Denote by W the Weyl group of G with respect to the maximal k- 
split torus in B. Then W acts on rational characters of B as usual (i.e., a(ip)(b) = ip(n~ 1 bn a ) by 
taking a representative n a of a), so W acts on z G C n and on s G C n as well. We will determine 
the functional equations of oj(x;s) with respect to this Weyl group action. The group W is 
isomorphic to S n x C% , S n acts on z by permutation of indices, and W is generated by S n and 
r : (zi, . . . , z n ) i — > (zi, . . . , z ra _i, — z n ). Keeping the relation (|2.8p . we also write A z (/) = A s (/). 
Since 

n 

i^(p)r +e =IIi^(Pi)r* t x^(p) ) 
i=i 

where is the i-th diagonal component of p G 5, the C-algebra map A^ is an isomorphism (the 
Satake isomorphism) 

X z : H(G, K) ^ C[q ±2z ^ , . . . , q ±2z -] W , (2.9) 

where the ring of the right hand side is the invariant subring of the Laurent polynomial ring 
C[q 2zi , g" 2zi , . . . , q 2z " , q- 2Zn ] by W. 
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By using a result on spherical functions on the space of hermitian forms, we obtain the 
following results. 



Theorem 2.1. The function G\{z) ■ oj(x; z) is invariant under the action of S n on z, where 

1 + q Zi ~ z i 



Gi(z)= n y 



(2.10) 



Proof. By the embedding 

K = GL n (Ok' 



K, h 



h 



jh*^j 
h 



and the normalized Haar measure dh on Kq, we obtain, for s S C n satisfying Re(sj) ^ — Re(ej), 1 sj 
i < n, 



oj(x; z) = u}(x) s) 



[ dhf \d{k ■ 
Jk Jk 



x)\ s+£ dk 



d(hk ■ x) 



dh 

Kq JK 

(i h) (D(k-x);z)dk. 

K 



i+e 



dk 



KJK 



d(hk ■ x) 



dhdk 



(2.11) 



Here D(k ■ x) is the lower right n by n block of k ■ x for { k 6 K \ k ■ x 6 X op }, and C* n \y'i z ) ls 
a spherical function on 7i n {k') defined by 



d h \y,z) 



d(h ■ y)\ s+£ dh, (h-y = hyh*), 



An 



where the variable z is related to s by (|2.8p . e is defined in (|2.4p . and h runs over the set 
{h G Kq I di(h ■ y) ^ 0, 1 ^ i ^ n}. The assertion of Theorem 12.11 follows from the next propo- 
sition. □ 

PROPOSITION 2.2. For any y E W n (k'), the function G\(z) ■ (* h \y; z) is holomorphic on C n and 
invariant under the action of S n . 

Proof. In |Hir05l §4.2], we have considered the following spherical function on % n (k') 



C W (^) = |det(y)|t f n|^-y) 



dh, 



where di(y) is the determinant of upper left i by i block of y, and the relation of z and s and e 
are the same as before, and showed that the function G\(z) ■ C^ h \y] z ) is holomorphic on C n and 
invariant under the action of S n . Since di(y) = det(y)d n -i(y~ 1 ) , we see 

n-l 



d h \y;z) = / Idet^-y)!^^^ T| Id^ih*- 1 -y' 1 ) 

JKo f = \ I 

„ n— 1 

/ Ul^-y- 1 

J tin 



Si+£i 



dh 



IdetCy- 1 )!"^^^ 



dh 



= &\y-\w), 

where w is the z-variable corresponding to the s-variable (s n -i> ■ ■ ■ ,s\, — (si + • • • + s n ) + § + 



(n — 1) under the relation (|2.8p . Then Wi — Wj = z n -j + \ — for 1 ^ i < j ^ n, 
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and Gi(w) = G\{z). Hence G\{z) ■ C,* h \y'-, z ) = G\{w) ■ C,^ h \y~ l ;w) is holomorphic and S n - 
invariant. □ 



2.2. Hereafter till the end of 21 we assume k has odd residual characteristic, i.e. q is odd. In 
this subsection, we give the functional equation of uj(x; s) for r G W. 

Theorem 2.3. For general size n, the spherical function satisfies the functional equation 

lo(x; z) = oj(x; t(z)). 

First we consider for ojW(x; s), the case of size n = 1, where z = —s and r acts as r(s) = —s. 
Proposition 2.4. For xi = ^ G X\, £ > 0, one has 

UJ^ l(X£\ s) = — — — -7- X — h 



1 + q -l y i _ q -2s i _ q 2s 

in particular, cjW(x; s) is holomorphic on C and satishes the functional equation 

oo {1) (x;s) =u (1) (x;-s). 

Proof. It is easy to see 

K = Ki = Kx,! U K 1)2 , where 

'a \ / 1 v/v 7 ^ 
a*" 1 / V We 1 + 



#1,1 = Hn 



, /a \ / TTUy/e 1 + 7TUf 



a G 0*„ it,i> G O a 

aG0* u,t; GO fe }., (2.12) 



and vol(Ki t \) = an d vol(K\p) = i1 q -i with respect to the measure dh on K normalized 

by vol(K) = 1. Let x$ be as above. For h G i^i i written as above, we have 

di(h ■ xt) = NiayW^dl + uvf - ir 2e u 2 s), 

-t if u G (7r), 

-^ + 2min{u 7r (l + w), ^} ifuG0£, 



v 7T (dx(h ■ x^) 
and 



1,1 

(V 1 + (i - T 1 ) ( (i - T 1 ) + £ <r 2fe ^><r*(i - T 1 ) + ff -"(-i)ff^ 



-1 



fc=l 



l + q- 1 

For /i G i^i,2 written as above, we have 

dx{h ■ Xi) = N{a)- 1 TT- i {-K n - v 2 /e), 
v n (di(h ■ Xi)) = — I + 2 min{f 7r (v), ^} 
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and 



/ 



\di(h-x e )\ s 5+ tog/ dh 



l + q- 1 



^ 9 - 2 *(-5><r*(i - <r x ) + <r 2£(s ~ V 



(-iy q 
1 + 1 



\fc=0 



- ( + (<r ] 



-2s 



Hence we obtain 

w(x^; s) = 



1 TT^/^I 

\d\{k ■ x e )\ s 2 io E9 dk 



Ki 



H Kr=0 



(-1)^-1 /^(l 

l + q- 1 

( z i)Vj i 
1 + (J- 1 <f - 



1 - g- 2s 
3 



2s ~ l ) + g-^(l - g 2 ^ 1 ) 



1 -o 2s 



which is holomorphic and invariant under s i— > — s. Since the set {x£ \ 1^0} forms a set of 
complete representatives of Ki\X\ (cf. Proposition II. 2J) , we conclude the proof. □ 



We assume n 2. As for the functional equation for r, we may follow a similar line as in 
[HirTTl §2.2]. Since G (= U(j 2n )) = J n U(H n )f n , where H n = and £ = ^ £ 

have to modify everything by this conjugation. Set 



wc 



n-1 



1 

1 



V 



\ 



ln-l/ 



then the standard parabolic subgroup P attached to r is given as follows 
P = B U Bw T B 







\ 


f ln-l 


a 




\ 


( ln-l 




p 


13 


\ 


< 


a 


b 




1 









1 





-P*3 






c 


d 







1 


—a*j 







1 






i, 




Q J 


V 






ln-l J 


V 






ln-l 


/ 



E G 



q is upper triangular in GL n ^\{k'), q' = jq* j 
" IA eUfo), a, f3 £ M n _i ) i(fc / ), 



v c dj 

7 GM„_ 1 (A; / ), 7 + 7* =0 
where j = j n -i and each empty place in the above expression means zero-entry. 



(2.13) 
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We consider the following action of P = P x GLi(k') on X = X x V with V = M21 (&:'): 
(p, r) -k (x, v ) = (p ■ x, p(p)vr~ 1 ), (p, r) G P, (x, v) G X, 

a 



where p(p) = ( ^ ^ ) for the decomposition of p G P as in (|2.13p . We define 



g(x, v) = det 



— V2 Vi 








ln-1 



X(n+1) 



(x, v ) G X, v 



(2.14) 



where X( n +i) is the lower right (n + 1) by (n + 1) block of x. Then we have the following. 



Lemma 2.5. Let g(x,v) be the function on X defined by i2.14\) . 

(i) g(x,v) is a P-relative invariant on X associated with the P-rational character ip(p,r) = 
^ n _i(p)iV(r)~ 1 ) and g(x,v ) = d n {x) with v = *(1 0). 

(ii) g(x,v) is expressed as g(x,v) = D(x)[v] by some hermitian matrix D(x) of size 2. For 
x G X°p, D x (x) = d n -i(x)- 1 D(x) belongs to X x . 

Proof, (i) It is easy to see that g(x,vo) = d n {x) and g((l,r) * (x,v)) = N(r)~ 1 g(x,v). Take an 
element p in P and write as 



q' 


a' 


7 ' 





p(p) 


a 











a b 
c d 



Then 



3((p, 1) * (a;, v)) =det 

= det 
= det 



-v 2 vi) 



-c a 



Ln-1 



p(p) 


a 





9 



"(n+l) 



«(— ^2 fl) 







9 



• ^(n+l) 










9 , 



— 1>2 «i 








ln-1 



"(n+l) 



= JV(det( 9 ))^(x,w) 

= i>n-i(p)g(x,v), 

where it = det(p(p)) G (= {tt£ 0* | JV(«) = l}) and /3 = (-«2«i) f _^ a e 

Hence we see that 



5((p,r) *(x,u)) = ip n -i(p)N(r) g(x,v), (p, r) G P. 



(2.15) 



(ii) Since g(x, v) is a linear form with respect to in v x , Vi and v\,v\ and g(x, v)* = g(x, v), it is 
written as D(x)[v] for some hermitian matrix D{x) of size 2. For x = Diag(a^ 1 , . . . , a" 1 , a n , . . . , a{) G 
X op , we have 



g(x, v) = det 



—V2 V\ 








ln-1 



Diag( y a n , a n , . . . 

,ai) 



(ai ••■ a n )uiUi + (ai • --ari-ia,, 1 )^. 
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Hence, for any diagonal x G X op , we have 

D(r) _ ( d n(?) 
K ] 1 d n (x)- l d n ^{x) 2 



= d n -i[x)\ n , / * s • (2.16) 

For any x G X op , we have x = b ■ y for some diagonal y G X op and b € B. Then, by (j2. 15|) . 

D(x)[p(p)v] = D(b ■ y)[p(jp)v] = ^ n -i(y)D(y)[«], 

hence, by (|2.16j) . 

£>(*) = Vn-i(2/) (p(^)*- 1 • D(y)) = Vn-i(y)d„-i(2/) (p^)*" 1 • Did,)) 
= d n _x(x) { P {bf- 1 ■D 1 (y)) , 

and Z?i(x) = pib)*- 1 ■ D^y) G X u since / 9(6)*~ 1 G G?j = U(j 2 ). □ 



Proof of Theorem \2.3[ By the embedding 

K l = U{j 2 )^K = K n , h^h 



Ln-l 



L n-1, 



we see 



w(x;s) = dh \d(k ■ x)\ s+£ dk 



dh / d(/i/c • x) 
Ki JK I 



ni*(*-*)i' 



i<n 



d n (hk ■ x) 



dhdk. 



(2.17) 



(2.18) 



For y G X op , we have 

d n (h ■ y) = g{h ■ y, v ) = g((h, 1) ★ (y, h^vo)) 

= g(y,h~ 1 v ) (since ip n -x(h) = 1) 

= DCy)^" 1 ^] = diC/t*- 1 • D(y)) = ^(y)^*- 1 ■ D 1 (y)), 
where d\{-) is the (1, l)-component of • . Since d\{x\) = di(x^ 1 ) for x\ G X\, we have 

d n (h • y) = d^MhW 1 ■ DMT 1 ) = d n - 1 (y)d 1 (h • D^y)- 1 ). 
Returning to (j2. 18|) . we have 

u{x;s)= ! TT \di(k ■ x)\ Si+ei I \d n —\(k • x)d\{h • D\(k • x) _1 )| Sn+£n dhdk 
= [ ]J\d i (k-x)\ Si+Ei \d n ^ 1 (k-x)\ s " +En ^ 1 \D 1 (k-x)- 1 ] s n )dk, 

JK i<n 

where u)^(y; s) is the spherical function of size n = 1. Then, by Proposition 12. 44 we obtain 

u(x; s) = uj(x; si, . . . , s n _ 2 , s n _i + 2s n , -s„), 
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which shows in z-variable 

uj(x;z) =(jj(x;r(z)), t(z) = (z x , . . . , z n _i, -z n ), 
and we conclude the proof. □ 

2.3. Since our spherical function u>(x;s) satisfies the same functional equations with respect to 
S n and r ( Theorem 12 , 1 1 and Theorem 12. 3p as cot(x; s) in [Hirllj does, we have the same functional 
equations with respect to W also. For the proof, we may follow a similar line as in [Hirlll §2.3], 
so we omit the details. 

We denote by E the set of roots of G with respect to the maximal fc-split torus of G contained 
in B and by S + the set of positive roots with respect to B. We may understand S as a subset 
in Z" - , and set 

S+ = S+US+, (2.19) 

= { e i - e j i e i + e j I 1 ^ i < 3 ^ n } ) = { 2e i I 1 ^ * < «} j 

where ej is the i-th unit vector in Z n , 1 ^ i ^ n. For each c G W, we set 

S+(cr) = { a G S+ | - a(a) € £+} . (2.20) 
We define a pairing on Z n x C n by 

(t,z)=5^t i z j , (tez n ,zec n ), 

i=l 

which satisfies 

{a, z) = {a{a), <j{z)) , («eS, zEC", ff£ W). 

Theorem 2.6. The spherical function lo{x\ z) satisfies the following functional equation 

uj{x;z)=Y a (z)-uj{x;a{z)), (2.21) 

where 

l_ g (°,*)-i 
r ^ (z)= 11 g <«,«)- g -i ' 

ae£+(<x) 

and we understand T a (z) = 1 if £+(cr) = 0. 

The next theorem can be proved in a similar line to the proof of |HirlH Theorem 2.9]. 

Theorem 2.7. The function G(z) ■ lv(x; z) is holomorphic on C n and W -invariant, in particular 
it is an element in C[g ±Zl , . . . , q n ] w , where 



°w = n tt^ft 
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An outline of a proof. It is clear that G(z) ■ uj(x; z) is invariant under the action of a 6 
{(i i + 1) £ S n \ 1 ^ i ^ n — 1} U {r} by Theorem 12.61 hence it is invariant for every a S W 
by cocycle relations of Gamma factors. 

In order to prove the holomorphy, we consider the following integral for any compactly sup- 
ported function cp in C°°(K\X): 

$(z;<p) = [ (p(x)\d(x)\ s+e dx, 
J x°p 

where dx is a G-invariant measure on X and the relation of z and s and e are the same as before. 
Then, the right hand side is absolutely convergent if Re(sj) ^ 1, (1 ^ % ^ n— 1) and Re(s n ) ^ 5, 
and continued to a rational function on q Sl , . . . , q Sn . Taking tp to be the characteristic function 
of K ■ x, we see $(z;tp) = vol(K ■ x) ■ u(x;z), hence it is enough to show the holomorphy of 
G(z) ■ ip). To begin with, §>{z; <p) is holomorphic on 



T>o = <z € 



- ^ Re(z n ), Re{z i+1 ) ^ Re(^) + 1, (1 < * < n - 1) 



and satisfies the same functional equations 

$(z;<p) =r a (z)<f>(a(z);ip), a € W. 
Since G(z) is holomorphic on T>q, G(z) ■ $>(z; <p) is holomorphic on 

U <t{Vq). 

cr&V 

We recall G\{z) in Theorem 12.11 and write 

G(z) = G 1 (z)xG 2 (z), G 2 {z)= [] /tCt-i - 

l<i<j'<Tj 

We obtain, in a similar way to the proof of Theorem 12.11 

$(z;ip)= I <p(x)(i h) (D(x);z)dx, 
Jx°p 

then we see G{z) ■ &(z; cp) is holomorphic on 

Pi = {z € C n I Re(zi + z,-) ^ 1, (1 < * < j < n)}, 

since ^2(2) is holomorphic on Pi and </3 is compactly supported. We see G(z) ■ &(z;(p) is holo- 
morphic on C n , since it is holomorphic on 

f>= \J cr(PoUPi), 

and the convex hull of the connected set T> is C n . □ 



3. The explicit formula for oj(x\z) 

3.1. We give the explicit formula of ui(x; z). Since uj(x; z) is stable on each iT-orbit, it is enough 
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to show the explicit formula for each x\, X £ A+ by Theorem II .11 
Theorem 3.1. For A G A„ ; one has the explicit formula: 

"(*a;*) = 1 , g „V H t ■ fa ,> - c a-Qa(^), (3.1) 

W2 n {-q - L - L , l + q( a ' z > 



where 



«, m (t) = J|(l - f ), C A = (-ljEiMn-f+lJg-EiMn-i+D, 

i=l 

Q A (*) = ^ a(f<^>c(z)), 



c(z) = n n ! <«,,) • ( 3 - 2 ) 

Remark 3.2. The above formula is the same as the explicit formula of ajxiyx', z) on A/p at ?/a G ATy 
parametrized by A G A+ in [HirlH Theorem 3.3]. We explain the relation between the spaces X 
and Ay's in Appendix [Cj 

We see that the main part Q\(z) of uj{x\;z) belongs to 1Z = C[q ±Zl , . . . ,q ±Zn ] w by Theo- 
rem [2T71 On the other hand Q\(z) is a Hall-Littlewood polynomial P\ of type C n up to constant 
multiple, which is introduced in a general context of orthogonal polynomials associated with root 
systems ([MacOO, §10]), and Qo(z) is a specialization of Poincare polynomial ( [Mac72[ Th.2.8]). 
More precisely, 

qA( ' ) = fr7i ' W (3 - 3) 

uTx(t) = w mo{x) {t) 2 ■ Y[ w me{x) (t), m e (X) =|t{t | Ai = ^} , 

and it is known that the set {Q\(z) | A G A+} forms a C-basis for 7?., and in particular, Qo(^) 
is a constant independent of z. For details see Appendix [Bl 



By Theorem 13.11 and Remark 13.21 we have the following corollary. 
Corollary 3.3. For x = l 2n , one has 

V ' ^ W 2n (-q- 1 ) 11 l + g<«,*> 

Proof. By definition, we see that cj(x; — e) = 1 with s-variable — e. We denote by z* the value in 
z- variable corresponding to — e. Since Qo(z) is independent of z, 

<2o(» = Qo(^ ) 



tM-g- 1 ) G(z*)J (1 + g- 1 )™ 
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and 



u}(l 2n ;z) = lv(x ;z) 



W2n{- 
-l\n.,, I „-l\2 



G(z) 



^2n(-9 _1 ) ^ 1 + ?<»>*> 

aes+ 



□ 



We will prove Theorem 13.11 by using a general expression formula given in jHirlOj (or in 
[Hir99]) of spherical functions on homogeneous spaces, which is based on functional equations 
of finer spherical functions and some data depending only on the group G. We need to check 
the assumptions there. Let G be a connected reductive linear algebraic group and X be a G- 
homogeneous affine algebraic variety where everything is assumed to be defined over a p-adic field 
k. For an algebraic set, we use the same ordinary letter to indicate the set of fe-rational points. 
Let K be a special good maximal compact open subgroup of G, and B a minimal parabolic 
subgroup of G defined over k satisfying G = KB = BK. We denote by X(B) the group of 
rational characters of B defined over k and by Xq(M) the subgroup consisting of those characters 
associated with some relative B-invariant on X defined over k. In these situation, the assumptions 
are the following: 

(Al) X has only a finite number of B-orbits (, hence there is only one open orbit X op ). 

(A2) A basic set of relative B-invariants on X defined over k can be taken by regular functions 
on X. 

(A3) For y E X\X op , there exists some ip in Xo(B) whose restriction to the identity component 
of the stabilizer M y of B at y is not trivial. 

(AA) The rank of X (B) coincides with that of X(B). 



In the present situation, our space X is isomorphic to U(j2n)/U(l2n) over k (cf. Appendix [Al 
and (|1.2p ). which is a symmetric space and (Al) is satisfied. (A2) and (A4) are satisfied by 
our relative i3-invariants {di(x) \ 1 ^ i ^ n}, where n is the rank of 3Co(B) = Xo(B) and X op = 
{x € X | di(x) ^ 0, 1 ^ i ^ n}. To check (A3) is crucial and rather complicated. 

We admit the condition (A3) for a while, which is proved in §3.2, and prove Theorem 13.11 
The set X op = {x € X \ di(x) ^ 0, 1 ^ i ^ n} is decomposed into the disjoint union of l?-orbits 
as follows: 

X°p =[_\X U , U = (Z/2Z) n , 

u£li 

X u = {x G X op | v 7T (d i (x)) = m H h m (mod 2), 1 ^ i < n} . 

According to the decomposition of X op , we consider finer spherical functions 

, f W=i\di(yT XyeXu, 

u u (x;s)= \d(k-x)\ s u +£ dk, \d(y)\ s u = l 

K 10 otherwise . 
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Then, for "generic z" , the set {u u (x,z) \ u G U} becomes a basis for the space of spherical 
functions on X associated with the same A 2 , where we keep the relation (|2.8p between s and z. 
Here "generic z n means that f(q Zl , ■ ■ ■ , q Zn ) 7^ for a polynomial f(x\, . . . , x n ), which comes from 
the bijectivity of Poisson integral (cf. [Kat8H Theorem 3.2]) and the condition (^43) (cf. [HirlOt 
Lemma 2.4]). For each character x oilA, we may represent as follows 



^2 x(u)uj u (x; z) = uj(x; z x ), (3.4) 
ueu 

where z x is obtained by adding to Z{ for suitable i according to x, and they are lin- 

logg 

early independent (for generic z) as varying characters x- By the functional equation of u(x;z) 
(Theorem I2.6p . we have for each a G W 

co(x; z x ) = T a (z x )uj(x; a(z x )) 

= T a (z x )u(x;a(z) a{x) ), (3.5) 



by taking a suitable character cr(x) of U. When % is the trivial character 1, the equation (|3.5[) 
coincides with the original functional equation of oj(x; z) and V^zx) = T a (z). By (|3.4p and (j3.5[) . 
we obtain vector-wise functional equations for finer spherical functions z) 

(lj u (x; z)) ueU = A' 1 ■ G(cx, z) ■ a A ■ (lj u (x; a(z))) uell , a G W, (3.6) 

where 

A = (x{u)) x ,u, a A = (a( X )(u)) XtU G GL 2 n(Z), 

X runs over characters of U, u G U, and G(a,z) is the diagonal matrix of size 2 n whose (x ; x) _ 
component is T a (z x ). Here we fix the first entry of x to be the trivial character 1. We denote by 
U the Iwahori subgroup of K compatible with B and take the normalized Haar measure du on 
U: 



U = <! v = ( Uij ) G K 



uu G O*, for 1 ^ i sC 2n, 
G irO k / if i > j 

Then it is easy to see, for any v G U and x\ with A G 



\di{vx x )\ = di(Diag(ir-*«,...,n- Xl )) = q^+-+ x ^ 
which means x\ G 1Z + in the sense of jHirlOL (2.8)]. We set 

5 u (x x ,z) = \d(u ■ x x )\ s + e dv. 
Ju 

Then we have 

( \d(x x )\ s+£ if x x G X u "j f c x q~^ z ) ifx A GX„ 
5 u (x x ,z) = l \ = l (3.7) 

[ otherwise. J [ otherwise. 

Applying [HirlO|, Theorem 2.6] to our present case, we obtain for generic z, by virtue of (j3.6j) . 

K(:r A ; z)) ueu = i ]T 7 (<r(z)) (A- 1 • G(a, z) • <M) (5 n (x A , a(z))) ueW , (3.8) 



22 



Spherical functions on the space of p-adic unitary hermitian matrices 



where 



(l- 9 -2)2 
1 _ Q 2(a,z)-2 l_ a (a,z}-l 



= n - 



-.2{ a ,z) 



n + T 



(3.9) 



Then we obtain 

uj(x\;z) = ^ l(u)u u {x\; z) 



the first entry of A (u u (x x ; z)) ueU 
the first entry of — ^ 1/(<t(z)) (G(cr,;z) • a A) (5 u (x\,(t(z))) u 



(1-g 



-2\ra 



W2n(-q *) 



- x ^ 7 (a(z))r ff (2;)^5 u (xA,o-(z)) 



ca(1 - 9" 



-2\n 



W 2n (-q X ) 



^- x ^ 7 ( ff (*))IV(z) g - 



(A,a( Z )> 



By Theorem 12.61 Theorem 12.71 ()3.2|) and (|3.9p , we have 

G(a(*)) 



G(*) 



7 (z)-G(z)=c(z). 



Thus we obtain the required explicit formula of u>(xa> for generic z, and it is also valid for any 



z G C ra , since G(z) • w(xa; z) is a polynomial in q ±zi , . . . , q^ 2 " 



□ 



3.2. In this subsection, we prove the space X n satisfies the condition (A3) by induction on n. 
For n = 1, the condition (.A3) is obvious, since X\ = X° p (cf. Proposition II. 2p . Hereafter we 
assume n 2. We set 

t(b) = Dia^(6i, . . . , b n , b~\ . . . , bj 1 ) G 5(= b = (& x , ...,&„) G (fc x ) w , 



^0 



b 

In A 



G S 



b G GL n (k'), upper triangular > , 



G B 



3 A + A*j = 



l n , 

Lemma 3.4. Assume x G X n and d\(x) ^ 0. Then, the orbit B ■ x contains an element of type 

= 1,71-, i/eI B -i. 



a- 1 





o s 





2/ 











a 



Here, if x $ X° p , then y $ X^_ x . 

Proof. By the action of Bq, we may assume x = (xij) satisfies 

X2n,2n = 1, 7T, X 2n ,j = £j,2n = 0, (n + 1 < j < 2n - 1) 

Then, by the action of Nb, we may change 

X2n,j = X jt 2n = 0, (2 j ^ n), X 2 n,l = ^l,2n S fc. 
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Then, by the property x* = x and j2nM = jm, we see 

Xl,j = Xj t i = 0, (j ^ 2), = x 2n ,2n~ 1 , 

hence may assume x has the shape as in the statement, and & x j2 n {t) = ~~ l)^j/j2n-2 (*)> hence 
y £ X n -i. The second assertion is clear. □ 



Lemma 3.5. Assume x £ X n , d\{x) = and the first non-zero entry in the 2n-th column from 
the bottom stands at (2n — i + 1, 2n) with 1 < I ^ n. Then there is some y = (yij) £ B ■ x which 
satishes 

Vt,3 = VjA = U2n,j = Vj,2n = $2n-t+l,j, 

Vt,j = Vj,i = Vin-t+lj = Vj,2n-e+l = $2n,j, 

where Sij is the Kronecker delta. 

The stabilizer B y contains t(h) with b\ = bj 1 = b £ k x and the remaining bi being 1, and the 
character tpi is not trivial on B y . 



Proof. By the action of Bq, we may assume x = (xij) satisfies 

X 2 n-e+l,j = Xj,2n-£+l = 



X2n,j — Xj,2n 



1 if j = 2n 

if n + l < j ^ 2n- 1, 

1 ifj = 2n-£ + l 

if n + 1 ^ j ^ 2n, j ^ 2n - i + 1. 



Then by the action of Nb, we may take y £ B ■ x such that 

'1 if j = 2n - i + 1 

y2nj' = 2/j,2n = < « if J = ^ 

k if j^£,2n-e + l, 

'1 ifj = 2n 

6 ifj = l, 

c if j = ^, 

[ if J 7^ 1, i, 2n, 



U2n-e+l,j — Uj,2n-e+l 



where a £ k and b,c £ k' . Then, by the property y = y* and j2n[y] = J2n, we see y has the 
required shape, and it is clear the stabilizer B y contains the elements in the statement. □ 



Lemma 3.6. Assume x £ X n , d\{x) = and the first non-zero entry in the 2n-th column from 
the bottom stands at (£, 2n) with 1 < i ^ n. Then there is some y = (yij) £ B ■ x which satishes 

Vl,j = Vj,l = $j,2n-e+l, V2n,j = Vj,2n = S e ,j, 

Vej = Vj,e = hn,j, y2n-e+i,j = yj,2n-e+i = 
where Sij is the Kronecker delta. 

The stabilizer B y contains t(h) with b\ = bi = b £ k x and the remaining bi being 1, and the 
character ipi is not trivial on B y . 
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Proof. By the action of B, we may assume x = (xjj) satisfies X2 n ,j = £j,2n = Sj^. Then, by the 
action of B, we may take y G B ■ x such that 

f a ifj = l 

y2n,j = = < i if i = ^ 
I o ifjVM, 

' 6 if j = l 
ye j =yje= I l if j = n 

, if jVU 

where a,b £ k' . Then, by the property y* = y and j2nM = J2n, we see y has the required shape, 
and it is clear that the stabilizer B y contained the elements in the statement. □ 



Lemma 3.7. Assume x G X n , d\{x) = and X2 n ,i = for 2 ^ i < 2n. Then x has the following 
shape: 



x = 




n-1 



£ = ±1, y€X n _i, ]"[ di(j/) = 0. 



i=i 



□ 



Proof. Since j2nM = i2n ; we see X2n,i 2 = 1 and x has the shape written as above and y = y* G 
X n _i. If y was diagonalizable by the action of £? n _i, then $^ 2n (t) = (t 2 - l) n_1 (t - C) 2 , which 
contradicts to the fact x G X n ; hence y cannot be diagonalizable and n^i 1 di(y) = 0. 

Lemma 3.8. Assume that x G X n has the following shape: 





( a 


* 




X = 


* 


y 
















0/ 



(i) Any anti-diagonal entry of x r equals toil, and under the B n -action, we may change x r into 
dj r with d = Diag(£i, . . . , £ r ). 

(ii) Assume further r = n. Then r is even, the numbers of +1 and —1 within {£j | 1 ^ i ^ n} 
are the same, and a^- = if & = £j. The stabilizer B x contains t(h) such that 



b if & = 1 
6- 1 if& = -l 



(&G fc x ), 



and the character tpi is not trivial on B x . 



Proof, (i) We prove by induction r. It is clear for r = 1. We assume the assertion holds for r and 
consider the case r + 1. Then we may assume that the upper right block x r+ i can be written as 



/ oi 







Ci \ 
o 

o / 
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Since j2nM = J2ni we have x' j r+ \x' = jV+i and = if £ = Then setting 6 G B as 

-a r £/2 



c 










l-2(n-j— 1) 













V o 



i 



/ 



the upper right (r + 1) by (r + 1) block of b ■ x becomes Diag(£i, . . . ,£ r >Qjr+i a s required. 

(ii) Assume r = n. Since < &xj 2 n(^) = (^ 2 — the numbers of 1 and —1 within {£j | 1 ^ i ^ n} 
are the same. Since ad + da = r , we see a^- = if ^ = £j, and i(b) the above type is contained 



in B n 



□ 



Now, in order to establish the condition (^43), it suffices to consider x of the following type: 



/ * 


* 


djr 


X = * 


y 





\ jrd 









G X n+r \X n p +r , y G X n , d= Diag(£i, . . . ,£ r ), & = ±1. 



Here we may consider the action of B n on y which keeps the shape of x as above. If d\{y) ^ 0, we 
may assume y has the shape as in Lemma 13.41 By the action of B n+r we may make every entry 
of x in the (r + l)-th row and column and (r + 2n)-th row and column into except (r + 1, r + 1)- 
entry and (r + 2n, r + 2n)-entry which are nonzero. Removing these rows and columns we have 
x' G X n+r ^i\X° p +r _ 1 of the same type as above. 

Thus we may assume that d\(y) = and y has the shape indicated in Lemma 13.51 or 
Lemma 13.61 By the action of B n+r , we can make every entry of x, outside of y, in the rows 
and columns of (r + l)-th, (r + £)-th, (r + 2n — t + l)-th, or (r + 2n)-th into 0, while keeping 
the shape of y. Then, by Lemma 13.51 and Lemma 13.6} we see ip r +i is not trivial on the stabilizer 

{B n +r)x- Q 



4. Spherical Fourier transform and Plancherel formula on S(K\X) 

We consider the Schwartz space 

S{K\X) = {<p : X — > C | left K-invariant, compactly supported} , 

which is spanned by the characteristic function of K ■ x, x G X, and an T~l(G, i^)-submodule of 
C°°(K\X) by the convolution product. We define the modified spherical function 

^(x-z) =u ! (x;z)/cj(l 2n ;z) e TZ = C[q ±z ' , . . . , q ±z "] w , (4.1) 

then by Theorem 13. 1| Corollary 13.31 fl£5D , we have 

*(x A ; z) = c x wxPx(z), w x = W ^~ q ^ (4.2) 
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We define the spherical Fourier transform 

F: S(K\X) — > U 

cp i— > F((p)(z) = f x (p(x)V(x;z)dx, 1 " ; 

where dx is a G- invariant measure on X. There is a G- invariant measure on X, since X is a 
disjoint union of two G-orbits, and G is reductive. We don't need to fix the normalization of dx 
at this moment, we will determine suitably afterward (cf. Theorem I4.5[) . We denote by v(K ■ x) 
for the volume of K ■ x by dx. For A G A+, we denote by ch^ the characteristic function of K ■ x\ 
and by ch^ the characteristic function of K ■ x\. Then, for A G A+ 

F(ch x )(z) = v(K ■ x)V{xx; z) = c x w x v{K ■ x x )P x {z). (4.4) 

We regard 1Z as an H(G, ET)-module through the Satake isomorphism 

Xz : U(G, K) ^ C[q ±2z \. . . , q ±2z "] W = 1Z . 

Theorem 4.1. The spherical Fourier transform F gives an T~L(G, K)-module isomorphism 

S(K\X)^C[q ±z \...,q ±z "} W (= 1Z), 

where 1Z is regarded as H(G,K) -module via X z . Especially, S{K\X) is a free H(G , K) -module 
of rank 2 n . 

Proof. Since the set {ch\ | A G A+} forms a C-basis for S(K\X) and {P x (z) | A G A+} forms 
a C-basis for 1Z (cf. Proposition IB.3| h F is bijective by (I4.4p . Hence F is an H(G, K)-module 
isomorphism, since we have for / G H(G,K) and ip G S(K\X), 

F(f*<P)= / fiaMd' 1 ■ x)^(x;z)dgdx 
JX JG 

= f(g- 1 )ip(y)^( y g-y 1 z)dydg= / ip(y) / f(g- 1 )^(g-y;z)dgdy 

JGJX JX JG 

= \ z (f)f tp(y)*(y,z)dy = \ z (f)F(<p), 
Jx 

where we use the fact f(g) = fig -1 ) for g G G. Since we see 

U = C[q Zl + q- z \ . . . ,q Zn + q- Zn f n , TZ = C[q 2zi + q~ 2z \ . . .,q 2Zn + g- 2 ^] s ", 
1Z is a free 7£o- m odule of rank 2™, and S(K\X) is a free -ftT)-module of rank 2 n . □ 



Corollary 4.2. All the spherical functions on X are parametrized by eigenvalues 
z e (C/T^r^)™ / W through H{G,K) — ► C, / .— > \ z (f). The set 

{ ^(x; z + u) | it G {0, n\J — 1 / log g} n } forms a basis of the space of spherical functions on X 
corresponding to z. 

Proof. The former assertion is clear, since a spherical function ^ G C°°(i ; C\X) satisfies, by 
definition 

f** = \ g (f)% f€H(G,K) (4.5) 
for some z G C n , and X z is determined by the class of z in fc/ 2 ^^ Z^ /W. 
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The above ^f(x; z + u) are linearly independent spherical function corresponding to the same 
X z (cf. (HQ} ). We define a pairing on S(K\X) x C°°{K\X) by 

(<P,V)= [ <p(x)V(x)dx, if G S(K\X), G C°°(K\X), 
Jx 

which satisfies 

(/*¥>,*) = (?,/**), (feH(G,K), <peS(K\X), V€C°°(K\X)). (4.6) 

Let | 1 < i < 2 n } be a free ilQ-basis of S(K\X). Assume that ^ G C°°(K\X), j G J 
are spherical functions corresponding to the same A z , and set 

a j = ( a ij)i G C2 "' a «J = / l Pi{x)^j{x)dx. 

Jx 

Then, by (|4.6|) and (|4.5|) . it is easy to see that for Cj G C 

EjeJ c i*i = ( in C°°(K\X)) ( W , £\ c,#,) = 0, 1 < % < 2" 

E ie j c,-a,- = 0( in C 2 "). 

Hence, there are at most 2 n linearly independent spherical functions, and *&(x;z + u)'s form a 
basis. □ 



We introduce the following inner product on 1Z. Set 

, 2tt , 



-1 

and define a measure dri = dfi(z) on a* by 



log? 



^"n!2«" (1 + ?-!)» ' \ c (z)\ 2 ' 

where c(z) is defined in f)3.2[) and is the Haar measure on o* with J" = 1. For P, Q G 7Z, we 
define 



(P, Q) n = [ P(z)Q(z)dn(z) 
J a* 



Lemma 4.3. For A, \x G A+, one has 

(P x ,P ll ) n = (P fl ,P x ) n = 8 x ^ 1 . 

Proof. Applying Proposition IB.3I to our case, Hall-Littlewood polynomials associated with the 
root system of type C n with t s = — g _1 and tg = q -1 , we see 

W {-q-\q- X ) x (1+q- 1 ) 2 



W x {-q-\q- 1 ) ^(-g- 1 ) 
by (|R9|) and (02J. □ 



Lemma 4.4. For A,/z G A+ such that |A| = \y\ (mod 2) 



(4.7) 



28 



Spherical functions on the space of p-adic unitary hermitian matrices 

Proof. We understand <S(x;z) G C°°(K\X) = Hom c {S (K\X) , C) as 

*(x ? ;z)ch 5 . (4.8) 

?eA+ 

For f eH(G,K), we write 

/*ch 5 = ^ 4(f)cK, (4.9) 

where almost all a|(/) = 0. Since \I/(:e;z) is a spherical function associated with [/ i-)- /(z) = 
A 2 (/)] for / € H(G, K), we have by gSD and g^]) 

/(z)$(x A ;z) = (/**( ;«))(s A ) = *(^;z)(/*ch 4 )(x A ) 
= ^ 4(/)*(x € ;z), 

and by (pL"2j) 

c A w; A /(z)P A (z) = ^ 4(/) W P^). (4.10) 

Taking the inner product with Pu(z), we have by Lemma 14.31 

c x w x (f(z)P x (z), P^))^ = (4.11) 

By the compatibility of F with T~L(G, i^)-action and (|4.4p . taking the image of P of (|4.9j) for 
£ = fM, we have 

c^w^v(K ■ x ft )f(z)P IM (z) = ^2 a%(f)c v w v v(K ■ x u )P u (z). 

ueA+ 

Taking the inner product with P\(z), we have by Lemma 14.3^ 

c^viK ■ x„) (f(z)P»(z), Px(z)) n = a£(f)c x v{K ■ x x ). (4.12) 
By (I4TTTD and <Q2|> . we have for any f eH(G, K) 

c>^(K • x M ) (/(z)P M (z), *M*)) W = ct> A ^K • x A ) (f(z)P x (z), P^)) n ■ (4.13) 

Now assume |A| = \fi\ (mod (2)), then x x = g ■ x^ for some g £ G. Taking / E H{G,K) as the 
characteristic function of the double coset KgK, we see o A (/) > and 

^ (f(z)P x (z), P»(z)) n = (Px(z), J(z)P^z))^ = (f(z)P^z), Px(z)) n ■ 
Thus we obtain, by P~13|) 

clw^v(K ■ Xn) = c\w x v{K ■ x\), 
which completes the proof. □ 

We recall that X decomposed into two G-orbits: 

X = G ■ Xq U G ■ xi, xq = l2n, %i = Diag(7r, 1, . . . , 1, vr _1 ). 
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Theorem 4.5 (Plancherel formula on S(K\X)). By the normalization of G-invariant measure 
dx such that 

v(K-x x ) = cfw^\ AgA+ (4.14) 
one has for any ip, tp G S(K\X) 



x 



(p(x)^(x)dx = / F(ip)(z)F{ip){z)du,(z). (4.15) 



Proof. We may normalize dx on X according to the G-orbits as v(K ■ xq) = 1 on G ■ xo and 

v(K ■x 1 ) = q 2n ~ 1 ^ 1 q J 1 on G ■ x u 

1 + q 1 

then it satisfies ()4.14p by Lemma 14.41 It suffices to show the identity f)4.15[) for ch^ and ch^ 
(A,/x G A+). Indeed, 



ch A (x)ch M (x)eb = 8x lfl v(K ■ x\) = <5 A>M c A w x , 

JX 

while 

f F{ C h x ){z)F( C h^{z)du.(z) 
J a* 

= c\w x v{K • x x ) • c^w^v(K ■ Xfj) (P\(z), Pn(z)) n = Sx^c^w^ 1 , 
which completes the proof. □ 
Corollary 4.6 (Inversion formula). For any ip G S(K\X), 

ip(x) = / F(ip)(z)^(x;z)d^(z), x G X. 

J a* 

Proof. For any x G X, we have 

v( x ) = —H7 — V / ( f(y) ch x(y)dy 



v(K ■ x) J x 
1 



v(K ■ x) J a 

F(v){z)^(x;z)du.(z) 



F(<p)(z)F(ch x )(z)dn(z) 



□ 



Appendix A. The spaces of unitary hermitian matrices 

In this subsection, let k! be a quadratic extension of a field k of characteristic 0, and consider 
hermitian matrices with respect to k'/k. As usual we denote by A* G M nm {k') the conjugate 
transpose of A G M mn (A). 
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We fix a natural number m and set H m (k') = {x G GL m (k') \ x* = x}. We define the unitary- 
group for x G H m (k') by 

f7(x) = {j£ GL m (k') | x[#] = x} , where x[#] = g*x£[ = g* ■ x, (A.l) 

and, in particular 

/0 V 

G = U(j m ) for j m = \ 

V 

We introduce the space X of unitary hermitian matrices and the G-action as follows: 

X = {x £ G \ x* = x} = {x G GL m (k') | x = x* , (xj m ) 2 = l m } , 

• x = 5x5* = gxj m g~ l i m (g £ G, x G X). (A. 2) 

We consider these objects as the sets of /c-rational points of^algebraic sets defined over k. We 
denote by k the algebraic closure of k and realize G(k) in G = Resw /k(GL m ) as follows. We 
understand G = GL m (k) x GL m (k) with the Galois group V = Gal(k/k) action defined by 

{(9 , i f7 )52 <J ) if a\k< = id ~ 
in rr\ ' f I ^ G r ' (51,52) G G), 

(92 ,91) lt(T\k'=T, 

where g a = (gij a ) for g = (gij) G GL m (k) and (r) = Gal(k' /k). Then 
G(fc) = {(g,g T )\ geGL m (k')}, 

G (k) = { (91,52) G G t g 2 jm9i = jm} = { (g,jmg~ x jm) | g G GT m (F)} , 
and the involution [g i — >• 5*] on G can be extended as (51,52)* = (*<72>*<7l) on G(fc). Hence we 



sec 



-^(^) — { ( x ->3rri x j m ) I X — j m X 1 j m G GL m (fc)| 

= { ( x ,jm X j m ) J X G GL m (k) , (xjm) = l m } , 

and the action of G(/c) on X(/e) can be written as 

(dijm 9 3m)) * (x, jm X jm) = (g,jm 9 jm)(x,jm X jm)(jm,g jm, <?) 

= (gxjmg~ 1 j m ,j m t g~~ lt x~ 1 jmg) 

= (gxj m9 3m, 3m (gxj m9 jm) jm)' 

Hence we may identify 

G(k) = GL m (k), X(k) = { X G G(k) | (xj m ) 2 = lm} , 

g -k x = gxj m g~ l j m , (g G G(k), x G X(k)), (A. 3) 

where g-kx = g- x\fg^G and x G X (cf . (|A.2[> ) . 

Proposition A.l. The space X(k) decomposes into G(k)-orbits as follows: 



in 



X(k) = | | |x G X(fc) | $ xjm (t) = (t- lf(t + 1)--} 

i=0 

where <&y(t) is the characteristic polynomial of the matrix y. 
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Proof. We consider the following G(k)-set: 

Y(k) = {yeG(k) \ y 2 = l], 

g°y = gyg~ 1 (g e G(k), y eY(k)). 

Then the G(/c)-orbits in Y{k) are determined by characteristic polynomials as follows 

m 

Y(k) = l\{yeY(k)\<5> y (t) = (t-iy(t + ir-*}. 

i=0 

Since the map 

■ip:X(k) — >Y(k), xi — > xj m 
is bijective and G ( k )-equi variant, we have the G(fc)-orbit decomposition for X{k) as required. □ 



We take the G(fc)-orbit in X{k) containing l m and set 

x(k) = G(k) * i m , x = x(k) n G = x(k) n x. 

By Proposition IA. 1 1 and its proof, we see 

X = {xG X\ *« ira (t) = * im (<)}. (A.4) 

Appendix B. Root systems and Hall-Littlewood polynomials 

In this appendix, we summarize several properties of symmetric polynomials, in particular Hall- 
Littlewood polynomials, which are understood as special cases of Macdonald polynomials. In 
Appendix [Bl we understand N = N U {0}. 

B.l Root systems 

Let V be an n-dimensional real vector space equipped with inner product ( , ). Let S be an 
irreducible reduced root system of rank n in V . We fix a set So = { ai \ 1 ^ i ^ n} of simples 
roots, and denote by S + the set of all positive roots of S with respect to T,q. We denote by 
Ao = { Hi | 1 ^ i ^ n} the set of fundamental weights satisfying 

(ai,fj,j) = 8ij, q v = 2q/(o,q) G V, 

and set 

n 

the weight lattice: A = ^j^Z^j, 

i=l 



the set of all dominant weig hts: A+ = 0N/Xi, 

it 

the coroot lattice: Q y = ^j^Za^. 



i=l 



i=l 

Let r a be the reflection defined by r a (v) = v — (v, a v )a for v G V, and W = W(S) be the Weyl 
group generated by {r a \ a G £}. 
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B.2 Symmetric polynomials 

We denote by C[A] the group algebra of the lattice A, which is spanned by the formal exponentials 
e x with A £ A. The Weyl group acts on C[A] via the action on A: o~(e a ) = e' 7 ^ for a G W and 
A £ A. We denote by CfA]^ 7 the subalgebra of 1-F-invariant elements in C[A]. For simplicity of 
notation we set 

K = C[A] W , 7£ = C[2A] w = 7£nC[2A]. (B.l) 

For each A G A + , we set 

m A = e u , WX = {a\ G A | a G W}, 
uewx 

then it is easy to see that {m\ | A G A + } forms a C-basis for 1Z. We define a partial order -< on 
A by 

fj, -< A if and only if A - [i G Q + , (B.2) 

where 

n 

Q+ = 0NQi c A. 
i=i 

Lemma B.l. For A, fj, G A + , there exist some a v G N (z/ G A + ) such that 

u<=A+ 

Proof. Let j4 = WX + VFu. and k£ A The VF-invariance of ^4 implies that there exists a G W 
such that ctk G A n A + . Write v = an = a\X + o"2/i for o"i, 02 G W. Since A >- a\X and /j, >- o"2/i, 
we have A + [i >- o\X + 02^. = v '■ Hence we obtain the result. □ 



Proposition B.2. 71 is a free IZo-module of rank 2 n . Any family {p^l \i G M} satisfying 



m, 



(B.3) 



[ i=i 



Cj G {0, 1}, 1 < i < n 



forms a free IZo-basis for TZ. 

Proof. Since A+ is a disjoint union of /i + 2A + , (u. G M), we see {p^ \ fi G M} forms a T^o-basis 
for 7?., by Lemma IB. 11 □ 



B.3 Hall-Littlewood polynomials 

We introduce a family of orthogonal polynomials, which is a special case of Macdonald polyno- 
mials, or can be regarded as Hall-Littlewood polynomials associated with root systems. 

We fix parameters t a G R with \t a \ < 1 for each a G S such that t a = tp if (a, a) = 
hence there are at most two independent parameters among t a 's. We define Hall-Little polynomial 
associated with the root system S, for A G A + , 
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where W\ is the stabilizer in W at A, and the Poincare polynomial of a subgroup W of W is 
defined by 

= e n *«. ( b - 5 ) 

o-eW aes+n(-o-s+) 
We define the measure cZ/i = d/j,(z) on a* as follows. 



d/x = d/i(2) = • tvt^> ( B - 6 ) 



log? 

tlW ' \c{z)\ 

nl _ f fl ( Q .2> 
^ r 



a* 



We regard e A E C[A] as a function on a* via e x (z) = q^^ X ' z \ Then we have 

and an inner product on 1Z is defined by 

(P,QH= [ P(z)Q{z)dn(z) (B.8) 

J a* 

for P,Q £ 1Z. Then it is known that the following holds. 

Proposition B.3 [MacOOl §3, §10]. {-P\}asA+ c ^ satisfies the triangularity condition like (jB.3[) 
and forms an orthogonal basis oflZ with respect to the inner product { , )n with 

By definition, we see W(t) = Wo(t). In the case of the root system of type C n , the explicit 
forms of the Poincare polynomial W\(t) and the Hall-Littlewood polynomial P\ with the special 
parameters used in the paper are given in (1B.9|) and in (jB.lOj) respectively. 

B.4 Poincare polynomials of stabilizers and Hall-Littlewood polynomials in the root 
system of type C n 

Proposition B.4. For A e A+, let 

S ,a = {a G So I (a,A) = 0} = y$ fc , 

k 

where each is a connected component of the Dynkin diagram corresponding to So, a- Denote 
by Wk the Weyl group generated by the reflections for a £ Then W\(t) = \\ k Wk(t). 

Proof. Since the stabilizer W\ is generated by the reflections that fix A (cf. |Hum90l 1.12, The- 
orem]), we see that W\ is generated by {cr a } a ^ x , where 

S A = {a G £ | (a, A) = 0}. 

Since £> is a root system, it is sufficient to show that So, A is a fundamental system of Y<\. Write 
a = °i a i ^ Sa- Then we have all c% ^ or all Cj ^ 0. Furthermore 

n 

= (a, A) = Ci(aj, A). 
i=i 
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Since (aj, A) ^ for 1 ^ i ^ n, we have Cj = for such i that (aj, A) / 0. Thus 



□ 

We use the realization of the root system of C n introduced in (j2. 19|) . Then we have 

So = {di - e i+ i | 1 ^ i ^ n - 1} U {2e n }, 

A = | Mi = ^ e fc 1 ^ i ^ n j , 

and we can identify the set A + of dominant weights with A+ = {A G Z" | Ai ^ • • • ^ A n ^ 0} . 
We fix any A G A+ and understand 

n n— 1 

A = ^ = ^2 ~ 'WlV* + ^nMn G A + . 

i=l i=l 

Then we have the decomposition 

oo 

S 0jA = {qgS | ( a ,A)=0}= [J$ fc , 

fc=0 

where 

'{ai G S | Ai = A m = A:} (A; > 0) 

^{a» 6 E | Ai = 0} (fc = 0). 

Let rifc = | Aj = k}. Note that = + 1 for > and no = (t$o- Then we see that 
is isomorphic to the Weyl group of type -An fe -i if fe > 0, and that Wo is of type C no . Setting 
WA (t s ) = Wc (t s ,ti) = 1 formally, we obtain by Proposition IB. 41 

oo 

Wx(t) = (jlWA^ts)) -W Cno (t s M 

fc=l 

where t s and are attached to short roots and long roots respectively. 

The Poincare polynomials of type A n _i and of type C n are respectively given as 

n-l , i+ i 



k 



w An _ 1 (t) = H- 



l-t l 



t ' 



i=l 

-1 _ j.i+1 
i=0 s 

In the case t s = —q and ti = q , we obtain 

(! + '. 

(l + g- 1 )™' 

Finally we arrive at the explicit form of the Poincare polynomials and the Hall-Littlewood poly- 



WcnC-g- 1 ^- 1 ) 



35 



YUMIKO HlRONAKA AND YASUSHI KOMORI 

nomials in the root system of type C n with t s = — q~ l and tg = q~ l as follows. 

W,(- q -\^) = ^^, (B.9) 



c{z) = rr 1 + ' rr L_gi ' 

oes+ ' aes+ 



(B.10) 



Appendix C. Relation with the space Xt 

We assume that k' /k be an unramified quadratic extension of p-adic fields. In this subsection we 
explain the relevance of the present space X = X n to the spaces introduced in [Hirll] , and show 
the expectation there is correct for odd residual characteristic case. 
In [Hirllj . we have considered for each T G H n (k') 

X T = Xt/U(T), X T = {xe M 2n , n (k') I H n [x] =T}, H n = ( £ M , 

where U(H n ) = {g G GL 2n (k') \ H n [g] = H n } acts homogeneously on Xt by the left multiplica- 
tion, and the stabilizer at a point in Xt is isomorphic to U(T) x U(T) (cf. [thrill Lemma 1.1]). 
We assume T is diagonal and realize Xt as a set of /c-rational points in an algebraic set defined 
over k. We set 

X T (k) = { (x,y) G M 2n ,n(k) @ M 2n , n (k) \ *ytf„x = T} , 
on which V = Gal(k/k) acts by 

(y- x-) iia\ k ,=T, 

where (r) = Gal(k'/k). We set 

U(#„) = I7(fl-„)(fc) = { (51,52) G GL 2n (fc) x GL 2 „(fc) I *y 2 tf n9 i = #„} , 
U(T) = l7(T)(fc) = { (hx,h 2 ) G GA,(fe) x GL n (k) \ l h 2 Th x = T} , 
X T (jfc) = £ T (fc)/U(T) D Xr(fe) = X T r , 

where we can consider the similar T-action on U (H n ) and U(T), since -ff n and T are T-invariant. 
We identify 

U(H n ) r = { (g,g) G GL 2n (k') x GL 2n (k') \ 'gHnd = H n ) with U(H n ), 
U(T) r = { (h,h) G GL n (k') x GL n (k') | *fcZ7i = T} with C/(T), 

where and henceforth we write g instead of g T for a matrix 5 with entries in k' . 

Lemma C.l. The map 

ip T :X T — ► Xr(fe), z^(T) 1— > (z,x)U(T) 

is injective. 

Proof. Assume <pt(xU(T)) = ipT(yU(T)). Then, for some (hi, h 2 ) G U(T), we have y = sc/ii, y = 
x/i2- Taking n linearly independent rows from x, we make xq G GL n (k'). Then yo = xo^i G 
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GL n (k'), h\ = Xq 1 ^ G GL n (k') and hi = xo _1 yo = h\ G GL n (k'). Hence (h\,h%) G U(T) and 
xU{T) = yU(T). □ 

Hereafter we understand Xt as a subspace of Xt(&) through 93-2". Set 

Tl = (o il)' * = ^=(^ i n °_ x 

Lemma C.2. Tie map 

f : X Tl (fc) — > X ln (k), (x,y)U(Ti) .— ► (x^,y^)U(l n ) 
is weiJ defined and sends Xy 1 (A;) into Xi n (fc). 
Proof. For any (x,y) G ^^(fc) and /i = (/ii, /12) G U(Ti), we have 

(xhiifo-, y/i 2 r?7r) = {xrfr,yrfr)%~ hrfr G (z%,2/%)U(l n ), 

hence / is well defined. Take any a = (x,y)U(Ti) G X^fe). For each <r G T, there exists some 
/icr G U(Ti) satisfying a(x,y) = (x,y)h a , and c(- v /7r) = ±y/Tr. Hence 

= (xr? 7r ,yr? 7r )^ 1 /i (T 7^U(l ri ) = (x^, yr7 7r )U(l n ) = /(a) 

Hence a/ = / for any a G T, and / sends the set Xt 1 (/c) of fc-rational points into to the set 
Xi B (fc). • - - q 

Lemma C.3. The set Xi n (fc) contains at least two U(H n )-orbits, X± n and /(X^)- 
Proof. By Lemma IC.21 we see 

x Tl c x Tl (fc) c X Tl (k) 



f 



f (ci) 



X ln C X ln (fc) C X ln (fc), 

hence it suffices to show X% n n /(X^) = 0. Assume there exists some (x,x) G 3&Ti> G 
(/ii,/i2) G C/(l n ) such that (xrj n ,xr] n ) = (y, y)(hi, ^2)- Taking suitable linearly independent 
rows from x, we have xq G GL n (k') and yo = XQ^h^ 1 G GL n (k'). Then we see 



/iir^ 1 =j/ 1 x G GL n (k'), /iirfr 1 = h 2 r] 7T 1 . 
Setting /i = /ii^" 1 , we have 

*/ll n /l = r]~ lt h2l n hri~ 1 = rjnlnVn = T l> 
which is impossible for /i G GL n (k'). □ 



We consider 

% 0\ A 2 
k J ' I & 2 



N 



(/»i,/» 2 ), (fci.fca) eU(U 



and the similar T-action on N as before. Then we may identify N r with 



N 



h 
k 



h,ke U(i n ) } . 
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Setting 



2 ' 

we see the stabilizer in U(H n ) at yo?7(l n ) G -Xi n is given by (cf. Ilirl li Lemma 1.1]) 

\ J-n J-n/ 

On the other hand, as is noted in (|1.12|) the stabilizer in G = U{j2 n ) at l2n is given by 



nN^-\ n=( ln _M eGL 2n (k). 

\Jn Jn J 



Since 



H n [u] 

hn[lA 



fin In \ / In = V\ = An 
£ln -lj Vfln Oj V° 

In Jn \ An -IrA _ 2 A" 

In -Jn/ U Jn / 1 _1 n 



we have 



fiu^UiH^ufi' 1 = G, ii,v- Xl U{H n )vn- 1 = G{k). (C.2) 
where we identify v and \x with their images in R k i / k {GL 2n ). Thus we have 

_ <p _ 

Xi„(fc) = U(F n )/^Ni/- 1 ^> G(k)/ fx'Nfi^ 1 X n (k) 

U U (C.3) 

Xi„(*;) DX ln U(H n )/ vNv^ 1 ^ G/fiNfi' 1 ^ G ■ l 2n C X n , 

where </? is the conjugation determined by (|C.2p . Then we have the following by the commutative 
diagram (|C.3p , Lemma IC.3[ and Theorem 11.91 

Proposition C.4. The above ip gives an isomorphism between the sets of k-rational points 

U(H n )\X ln (k) *± G\X n , 

and U(H n )-orbit decomposition 

X ln (k)=X ln Uf(X Tl ); X ln ^G-x , f(X Tl )^G- Xl , 
where xo and x\ are the representatives of G-orbits in X n given in Theorem \1.9l 

Now we assume that q is odd and consider the Cartan decomposition of Xt = 3£t/U(T). Set 
K' = U(H n ) n GL 2n (O k ,) and recall K = G n GL 2n (O k <). Since 2 £ (vr), we see fj, G GL 2n {O k <) 
and 

Hv^K'vu' 1 = K. 
Hence we have the bijective correspondence 

K'\X ln (k) <— > K\X n , 

and we see the space Xt inherits the Cartan decomposition of X n , the space of unitary hermitian 
space. Thus we have the following. 
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Theorem C.5. Assume k has odd residual characteristic and take any T £ 7i n (k'). Then 



A ~ T means that |A| = v 7T (det(T)) (mod 2) and guarantees the existence of h\ £ GL n (k') 
satisfying T = it x [h\] . 

The above decomposition has been expected in 1 lir 1 1 , Remark 4.2]. In |Hirllj . where we 
have known the disjointness of orbits in the right hand side by explicit formulas of spherical 
functions u!t(u',z), but we didn't know they are enough. By Theorem IC.51 we see the spherical 
Fourier transform Ft is isomorphic in [Hirlll Theorem 4.1] if q is odd. 
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